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DATA CONVERSION APPARATUS FOR DATA and display link destination information converting iinit for : 

COMMUNICATION SYSTEM converting the piece of link destination information speci- 
fying the other document as the link destination into a piece 

BACKGROUND OF THE INVENTION of display link destination information, the piece of display - 

...... ., . 5 link destination information being related to a serial number 

(1) Field ot me Invention corresponding to the supplementary design added by the 
This invention relates to a data conversion apparatus used supplementary design adding unit, where the piece of dis- 

forWbroadcasting systems, and more specificaUy to a data p i ay H n k destination information specifies, as a link 

conversion apparatus for converting HTML (Hyper Text destination, another display image which is a display image . 

Markup Language) documents into information of a format 10 0 f t he other document generated by the display image 

suitable for me TV broadcasting systems. generating unit. 

(2) Description of the Prior Art With such a construction, since the display , image ele- 
In recent years, the Internet has become a very popular ments respectively linked to other display images are visu- : 

system for obtaining or exchanging information. A great ally emphasized by the supplementary designs, the user can ■ 
number of users view information stored in each site called 15 easily find and such display image elements on the display, 
home page on the WWW (World Wide Web). In doing so, screen. Also, with the serial numbers attached to the supple- 
users make interactive operations on the home pages using mentary designs, the user can specify a desired link- 
a keyboard or a mouse. In particular, users can move a destination display image by using, for example, a remote 
pointer using a keyboard or mouse to select "hot spots," controller of a TV set. 

which results in a jump to another screen. One example of 20 \ n the above data conversion apparatus, the display image 

such interactive operation techniques is Netscape Navigator element generating unit may include: a conversion table 

developed by Netscape Communications Corporation. storing unit for storing a character size of the .character 

Conventional interactive operation techniques have been string; and a display image element generating unit for 

created on the assumption that a pointing device, such as a converting the character string into a display image element 

Q keyboard or mouse, which are peripheral devices of 25 according to the character size and converting the piece of 

^ computers, is used to input instructions, not a remote con- image information into a display image element. 

^ troller of a TV set. That means, it is difficult to use such j n the above data conversion apparatus, the conversion: 

y3 remote controllers for the interactive operations required on , table storing unit may further store respective starting posi- 

|a& the home pages on the WWW in the Internet. ^ tions in a horizontal direction of the display image elements, 

fs% where the display image generating unit includes: a display 

SUMMARY OF THE INVENTION position calculating unit for reading the starting posiUons of 

« It is therefore the object of the present invention to thc dis P la y image elements and calculating respective dis- 

M provide a data conversion apparatus for multimedia data P la V positions of the display image elements in the display 

pi which enables interactive operations on home pages dis- 35 image; and a display image generating unit for; generating 

* ~ played on the TV screen by using a remote controller of the me dis P la y ima S e b y arranging the display image elements 

s TV set in the display image according to the display positions. 

D The above object is achieved by a data conversion appa- In the data conversion apparatus, the display image geh- 

Sj ratus which is used as a data transmitting apparatus in a data eratm S unit generates a plurality of display sub-images from 

n I communication system, where the data communication sys- 40 the document, where the display lmk destination informa- 

l j* tem achieves pseudo interactive communications by using ^ converting unit includes: a display link destination 

US one-way communications between the data transmitting information generating unit for generating a plurality sets of 

Q apparatus and a plurality of data receiving apparatuses, the P icces of ^P 1 ^ link destination information which respec, 

J 8 ? data conversion apparatus including: document storing unit ^vcly correspond to the plurality of display sub-images 

*** for storing a plurality of documents each of which includes 45 generated from the document. ,: : . ; . , -y,\- 

at least a character string and at least a piece of image With such a construction, since pairs of a display image 

information, where at least one of the character string and and a piece of display link destination information are held 

the piece of image information includes a piece of link inside the data conversion apparatus, the user can easily 

destination information which specifies another document as operate on display screens such as TV screens on which the 

a link destination; supplementary design storing unit for so scrolling function cannot be used. 

storing a list of supplementary designs with serial numbers In the data conversion apparatus, the supplementary 

respectively related to the supplementary designs; display design storing unit may include: a maximum number storing 

image element generating unit for reading the character unit for storing a maximum number of the supplementary 

string and the piece of image information one at a time from designs in the display image, where the display image 

the document storing unit and converting the character string 55 generating unit further includes: a maximum number judg- 

and the piece of image information into respective display ing unit for judging whether the number of the supplemen- 

image elements, where the display image elements are tary designs to be arranged in the display image exceeds the 

bit -mapped graphics; display image generating unit for maximum number; and a display image dividing unit for, 

generating a display image which is composed of the display when the maximum number judging unit judges that the 

image elements, where the display image has a size which 60 number of the supplementary designs exceeds the maximum 

is equivalent to a size of display screens of the plurality of number, sending an instruction to the display image gener- 

data receiving apparatuses; supplementary design adding ating unit to divide the display image into the plurality of 

unit for reading a supplementary design corresponding to the display sub-images so that supplementary designs less than 

piece of link destination information specifying the other the maximum number are added to each, of the plurality of 

document as the link destination from the supplementary 65 display sub-images divided from the display image,. where 

design storing unit and adding the supplementary design to the display image generating unit generates the plurality of 

a corresponding display image element in the display image; display sub-images according to the instruction. 
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In the data conversion apparatus, the display link desti- FIG. 5 shows HTML document "Tokyo.htmr which is an 

nation converting unit may further include: a display link image displayed on the second page of the home page in the 

destination sub-information generating unit for generating a first embodiment; 

plurality sets of pieces of display link destination sub- FIG. 6 shows HTML document "Osaka.htmr which is an 

information which respectively correspond to the plurality 5 j e a^yed 0D me third page of the home page in the 

of display sub-images generated by the display image gen- first embodiment; 

^Srch a construction, since the number of display FI °-. 7 shows an example of the link information table 

image elements linked to other display images in a display sto <^ ?n the data "ovejsion lable stonn g ™« m ^ fot 

screen are limited to a certain number, the user can easily 1Q embodiment; 

specify a desired link-destination display image by using, FIG. 8 A shows the display image information in the first 

for example, a remote controller of a TV set. page of the home page in the first embodiment; 

In the data conversion apparatus, the display image gen- . FIG. 8B shows the audio information in the first page of 

erating unit may generate the plurality of display sub-images the home page m the first embodiment; 

sp that each of the plurality of display sub-images includes i$ mQ gQ sbows ^ ^ information in the first ge of the 

display image elements of a same category. home page in the first embodiment; 

In the data conversion apparatus, the document may be r ° . . . 

written in HTML, where the display image generating unit FK3..-9A shows the display image information in the 

determines categories of the display image elements from second P a S e of home P a S c m the embodiment; 

tags written in the document! FIG. 9B shows the link information in the second page of 

With such a construction, display image elements in a 20 the home page in the first embodiment; 

document in the same category are displayed on the screen FIG. lOAand FIG. 1QB show the transmission data which 

as a group. This is convenient for the user when switching . -is the third page of the home page in the first embodiment; 

screens. FIG. 11A gives a graphic representation of the trahsmis- 

The data conversion apparatus may further include: infor- ^ s ibn method used by the transmitting unit in the first 

M mation obtaining unit for obtaining, via a communication embodiment; 

^0 line, a document written in HTML (Hyper Text Markup fig. 11B shows the multiplexed stream which is trans- • 

yg Language) which includes at least a character string and at mil j ed when digital broadcasting is used in the first ; 

least a piece of image information; and information writing embodiment- 

rj .- . unit for writing the document written in HTML into, the 30 ^ u ^ & showing aQ ^ cp/ ^ w Qf ^ 

W 1 document stonng unit. : ^ procedure of the data transmitting apparatus in the first 

fg The above data conversion apparatus may further include: emDO diment* 

~ . first storing unit for storing a plurality^ ^ / . fl fa 

py the plurahty of display sub-images; second storing unit for 35 , if Hi t* 

storing a plurality sets of pieces of display link destination V*^^ ^^-l*'- ■ .v'-.'. . v r 

L : information which are generated by the display link desti- FIG.' 14 is a flowchart showing an example procedure for 

0 Nation information cooVerting unit and arc' r^ectively- generating transmission data by the transmission data gen- 
SJ related to the plurality of video frames, where each of the . eratin g * mt m & e first embodiment; 

. plurality sets of pieces of display link destination iriforma- ^ FIG. 15 is a flowchart showing a detailed example of the 

i y tion having the same identifier as the identifier of a corre- processing in step S1312 of FIG. 14; 

01 sponding video frame; and broadcasting unit for cyclically FIG. 16 shows an example of the cursor design corre- . 
Q transmitting a certain number of video frames in the first spondence table which the control unit in the first embodi- 
1^ storing unit and corresponding sets of pieces of display link ment generates to control the display position of the cursor ; 

destination information in the second storing unit. 45 design; ■ 

With such a construction, it is possible for the user to FIG. 17 shows an example of the design information 

perform pseudo interactive communications with one-way stored by the control unit in the first embodiment; 

communications in which data is transmitted from the data pjc. 18 shows the display image for the initial screen 

transmission apparatus. which is displayed by the display unit based on the trans- 

1 BRIEF DESCRIPTION OF THE DRAWINGS 50 mission data shown in FIGS. 8A to 8C; 

n , . . . j " j r * c u FIG. 19 shows the displav image which is the initial : 

These and other objects, advantages and features of the - j. , j w Vu A - i " VeL a*** 

invention wiU become apparent fro* 'the foUowing descrip- ««™ \] rthe d^play unit for the transmission data 

tion thereof taken in conjunction with the accompanying shown m FIGS. 9A and 9B v- 

drawings which illustrate a specific embodiment of the „ FIG. .20 shows the display image which is the initial 

invention. In the drawings: . ***** displayed by the display unit for the transmission data. 

FIG. lis a block diagram showing the construction of the shown in FIG. 10A and 10B; 

data communication system of the present invention FIG. 21 is a flowchart showing an example procedure for 

described in the first embodiment; d *P la y conlro1 which is performed by the control unit in the 

FIG. 2 shows an example of the file list stored in the file w first embodiment; • 

list storing unit in the first embodiment; FIG. 22 shows the construction of the data conversion ; 

FIG. 3 shows HTML document 301 "Report.htmr which apparatus in the second embodiment of the present inven- 

is the first page of a home page provided by a WWW server Uon i 

in the first embodiment; FIG. 23 shows an example document stored in the infor- 

FIG. 4 shows image information "Weather.gif" which is 65 mation obtaining unit in the second embodiment; 

an image displayed on the first page of the home page in the FIG. 24 shows an example document stored in the infor- 

first embodiment; mation obtaining unit in the second embodiment; 



5 

FIG. 25 shows an example image stored in the informa- 
tion obtaining unit in the second embodiment; 

FIG. 26 shows the image of FIG. 23 displayed on the 
display screen by using a conventional WWW browser; 

FIG. 27 shows the image of FIG. 23 displayed on the 5 
display screen by using a conventional WWW browser; 

FIG. 28 shows a font table stored in the data conversion 
table storing unit in the second embodiment; 

FIG. 29 shows a link information conversion table stored 10 
in the data conversion table storing unit in the second 
embodiment; 

FIG. 30 shows a list of cursor designs stored in the cursor 
design storing unit; 

FIG. 31 shows an example image haying been converted 15 
and stored in the temporary information storage unit in the 
second embodiment; 

FIG. 32 shows an example image having been converted 
and stored in the temporary information storage unit in the q 
second embodiment; 

FIG. 33 shows an example piece of link information 
stored in the temporary information storage unit in the 
second embodiment; 

FIG. 34 is a flowchart of the operation in the second 25 
embodiment; 

FIG. 35 shows the construction of the data conversion 
apparatus in the third embodiment of the present invention; 

FIG. 36 shows a remote controller which transmits signals 
to the signal receiving unit described in the third embodi- 30 
ment; 

FIG. 37 shows an image and a piece of link information 
stored in the temporary information storage unit in the third 
embodiment; ^ 

FIG. 38 shows an image and a piece of link information 
stored in the temporary information storage unit in the third 
embodiment; 

FIG. 39 shows an image and a piece of link information 
stored in the temporary information storage unit in the third 40 
embodiment; 

FIG. 40 is a flowchart of the operation in the third 
embodiment; 

FIG. 41 shows an image and a piece of link information 
stored in the temporary information storage unit in the fourth 45 
embodiment; 

FIG. 42 shows an image and a piece of link information 
stored in the temporary information storage unit in the fourth 
embodiment; and 

'FIG. 43 is a flowchart of the operation in the fourth 50 
embodiment. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 
First Embodiment 55 

FIG. 1 is a block diagram showing the construction of the 
data communication system 100 which is described in the 
present embodiment. This data communication system 100 
is composed of a data transmitting apparatus 110 and a 
plurality of data receiving apparatuses 150. 60 

The data transmitting apparatus 110 includes an informa- 
tion obtaining unit 111, a transmission data generating unit 
112, a transmission data holding unit 113, a transmission 
data reading unit 114, a multiplexing unit 115, and a trans- 
mitting unit 116. 65 

Each data receiving apparatus 150 includes a separating 
unit 151, a received data holding unit 152, a reproducing unit 
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153, a display unit 154, a control unit 155, a signal receiving 
unit 156, and an audio output unit 157. 
Construction of the Information Obtaining Unit 111 

The information obtaining unit 111 includes a file list 
storing unit 121 and a buffer (not-illustrated) which holds 
information obtained from an external database, such as a 
WWW server. The file list storing unit 121 stores a file list 
200 in which the file names of files that are to be obtained 
by the information obtaining unit 111 and the addresses of 
these files are stored corresponding to serial numbers which 
show the order in which the files are to be obtained. 

FIG. 2 shows an example of the file list 200 stored in the 
file list storing unit 121. In the file names given in this list, 
the extension "html" indicates that a file is an HTML 
document, the extension "gif* indicates that a file is an 
image which has been compressed according to GIF 
(Graphics Interchange Format), and the extension "au" 
indicates that a file is audio information in AU format. 

This file list 200 shown in FIG. 2 shows the case when the; 
information obtaining unit 111 is connected to the Internet 
and obtains information from WWW servers.. In this 
example, the file list 200 is a table in which the URL 
(Uniform Resource Locator) of a directory on a WWW 
server is stored in the address column 202 corresponding to 
each number in the serial number column 201. In the present 
example, each page in a home page provided by a WWW 
server can be composed of an HTML document and image 
files and audio files whose file names are indicated by the 
HTML document. As a result, the file name of the HTML 
document for each page is grouped together with the file 
names of the accompanying image information files and 
audio files in the file name column 203 of the file list 200. 

It should be noted that there can be cases when the address 
and file names stored in file list storing unit 121 for each 
serial number in the file list do not need to be recorded 
separately, so that they may instead be represented using a 
single URL. It is also possible for files to be obtained not 
from a WWW server, but from an external database. In this 
case, the address of the file is expressed as the address of a 
device in the external database and the file is expressed by 
a file address in the database. 

The information obtaining unit 111 reads a URL and the 
file names which are to be obtained from the URL from the 
file list storing unit 121 in ascending order of the serial 
numbers in column 201. It then accesses the WWW server 
indicated by the URL to obtain the indicated files. The 
information obtaining unit 111 assigns file names, to the 
obtained files and stores the files in the buffer. 
Examples of files 

The files obtained by the information obtaining unit 111 
are described below, with reference to FIGS 3, 4, 5, and 6. 

FIG. 3 shows the HTML document 301 "Report.htmr 
which is the first page of a home page provided by a WWW 
server. The notation 'HTML document 301 "Report-html"' 
indicates the file of HTML document 301 whose file name 
is "Report.html." 

In HTML documents, character strings written inside 
"o" brackets are called tags. These tags represent control 
codes and are used in pairs written as "<character string>" 
and "</character string>". The control codes in tags indicate 
the execution of a corresponding control operation. 

Tags "<HTML>" on line 311 and "</HTML>" on line 323 
in FIG. 3 indicate that the character strings between these 
tags form a single HTML document 301. 

Tags "<H1>" and "</Hl>" on line 312 indicate that the 
character string "WEATHER REPORT' between these tags 
is the headline of this document. 
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Tags "<CENTER>" on line 313 and "</CENTER>" on 
line 315 indicate that the part of the document expressed by 
the character strings between these tags should be centered. 

'<IMG SRCVWealher.gif V on line 314 indicates that 
the image information 401 "Weather.gif ' shown in FIG. 4 is 
to be displayed in the document. Here, "SRC=" is an 
attribute of tag "<IMG>" and indicates an image informa- 
tion file. The attribute content of "SRC«" is "Weather.gif ', 
indicating a file name. 

FIG. 4 shows the image information 401 "Weather.gif* 
which is an image displayed on the first page of the home 
page- 

As shown in FIG. 4, the image information 401 stored in 
image information file "Weather.gif ' is a map of Japan 
which includes weather information. 

Tags "<P>" on line 316 and "</P>" on line 317 indicate 
that the character string "TOMORROW, THE WHOLE OF 
JAPAN WILL ENJOY SPRINGLIKE WEATHER" between 
these tags is a single paragraph. 

Tags "<UL>" on line 318 and "</UL>" on line 322 
indicate that the display items expressed by the character 
strings between these tags are displayed as an itemized list 
without serial numbers. . 

Each of the tags "<L1>" on lines 319 and 320 indicates 
thai the character string between this tag and the next 
"<L1>" or "</UL>" forms an item in the itemized list. 

*<AHREF-"Tokyo.html>TOKYO </A>'on line 319 of 
FIG. 3 indicates that the character string "TOKYO" is linked 
to the HTML document 501 "Tokyo.html" which is shown 
in FIG. 5. Here, character strings or images which are linked 
to other files, such as this character string "TOKYO", are 
called hot spots or anchor points. As one example, if a user 
uses the mouse to select the hot spot "TOKYO" which 
displayed on a computer monitor by a browser, the HTML 
document 501 "Tokyo.html" will be read by the browser and 
is displayed on the screen.; Here, the attribute of tag "<A>", 
"HREF-", represents a link destination, and the attribute 
content of "HREF*-", ih this case "Tokyo.html", indicates a 
file name for the link destination file. 

* < A HREF-"Osaka h tml"> OSAKA <JA>\ on line 320 of 
FIG. 3 indicates that the character string "OSAKA" is linked 
to the HTML document 601 "Osaka.html" which is shown 
in FIG. 6. Accordingly, this character string "OSAKA" is 
also a hot spot. If hot spot "OSAKA" is selected, HTML 
document 601 "Osaka.html" will be displayed on the screen. 

'<A HREF«"Weather:au">AUpiO INFORMATION 
</A>' on line 321 of FIG. 3 indicates that the character string 
"AUDIO INFORMATION" is linked to the audio file 
"Weather.au.", making it another hot spot. If the hot spot 
"AUDIO INFORMATION" is selected, the audio file 
"Weather.au." will be reproduced. 

FIG. 5 shows the HTML document 501 "tokyo.html" 
which is the second page of the home page. The tags 
included in the HTML document 501 have already been 
explained, so that the following explanation will only deal 
with the links to other pages. 

<<A HREF«"Report.html">RETURN </A>' on line 511 
of FIG. 5 indicates that the character string "RETURN" is 
linked to the HTML document 301 "ReporLhtml" which is 
shown in FIG. 3. 

FIG. 6 shows the HTML document 601 "Osaka.html" 
which is the third page of the home page. 

*<A HREF-"Report.html">RETURN </A>' on line 611 
of FIG. 6 indicates that the character string "RETURN" is 
linked to the HTML document 301 "Report.html" which is 
shown in FIG. 3. 

The information obtaining unit 111 may obtain all the files 
listed in the file list 200 in order and store all of the obtained 
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files in its buffer. Alternatively, the information obtaining 
unit 111 may obtain the listed files in units of one page and 
store the obtained files in the buffer. In this latter case, the 
files for a next page are only obtained after the processing of 
5 a current page has been completed by the transmission data 
generating unit 112. 

Construction of Transmission Data Generating Unit 112 

The transmission data generating unit 112 includes a data ; 
conversion table storing unit 122 and a storage area (not 

10 shown in the drawings) which is used as the work area for 
generating transmission data. The data conversion table 
storing unit 122 includes a tag table, font files, and a link 
information table. The tag table is a list of control operations 
for every available HTML tag which each has its own flag. . 

15 The font files each include character fonts for TV display . • 
which are classified for different purposes. The link infor- : ; 
mation table is a table which expresses the link information 
for hot spots in a format recognized by the data communi- ■ 
cation system 100. The work area is composed of a file > 

20 storage area, a tag storage area, a character string storage 
area, and a flag storage area. The file storage area stores one 
HTML document file. The tag storage area stores the char- 
acter strings which are written inside the "<>" brackets of ..";>, 
each tag. The character string storage area. stores character 

25 strings other than the ones between the "<>" brackets. The : 
flag storage area is an area where flags which are used for % 
controlling the generation of display image information for ;V: 
one frame of image data are set. The character strings stored : : 
in the tag storage area and the character string storage area : : 

30 are deleted when the control operations corresponding to the \ - v- 
tags (flags) have been completed. If a plurality of flags are 
present in the flag storage area, the flags are set in ascending 
order and are reset in descending order. . ; 

FIG. .7 shows an example of the link information table 700 ■ 

35 stored in the data conversion table storing unit 122, where / : 
me : numbers, such as "9", are derimal values. 

As shown in FIG. 7, the link information stored in the link 
information table 700 is composed of index information 701 : 
and hot spot information 702. 

40 Index information 701. is composed of an Mormation : 
identification part "INDEX-" for identifying the informa-! 
tion as index information and a file identification number 
expressed as a four-figure decimal value. This file identifi- . : 
cation number is the identification number of a transmission 

45 data file which includes the current piece of index informa- : 
tion 701. 

Hot spoi information 702 is composed of an information 
identification part "HOTSPOT-" for identifying the infor- " 
mation as hot spot information, X-Y coordinates "X«999, \ 

50 Y-999", for indicating a cursor position in the current, 
display screen, an instruction "GO__TO,_PAGE" which 
corresponds to the cursor position given by these > 
coordinates, and a four-figure decimal variable showing the 
identification number of the transmission file linked to this 

55 cursor position. 

The transmission data generating unit 112 treats one set of . 
the display image information to be generated along with the 
accompanying audio information and link information as a 
single transmission data file, based on one HTML document. . ; 

60 Here, the transmission data generating unit 112 establishes 
a storage area in each of the display image information : 
storing unit 123, the audio information storing unit i24, and ■: 
the link information storing unit 125 which are provided in y. • 
the transmission data holding unit 113 (described later) so . : 

65 that the display image information, audio information, and , 
link information to be included in one transmission data file : 
are interrelatedly stored. Hereinafter, the storage areas in the 
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display image information storing unit 123, the audio infor- 
mation storing unit 124, and the link information storing unit 
125 are respectively called the display image information 
storage area, the audio information storage area, and the link 
information storage area. 5 

The transmission data generating unit 112 assigns a same 
identification number to the display image information stor- 
age area, the audio information storage area, and the link 
information storage area used for storing the corresponding 
kinds of information in a same transmission data file. Here, 10 
the transmission data generating unit 112 manages the audio 
information and link information in a same transmission 
data file as separate files which are given the same identi- 
fication number. This identification number may correspond 
to the serial number in column 201 of the file list, which in 15 
turn corresponds to the file names of the present files which 
are given in column 203. 

The transmission data generating unit 112 fetches an 
unprocessed HTML document file which has been obtained 
by information obtaining unit 111 from the buffer in the 20 
information obtaining unit 111 in accordance with the serial 
number 201 in the file list 200. The transmission data 
generating unit 112 then writes the file into the file storage 
area of the work area, in addition to generating the index 
information in accordance with the format of the index 25 
information 701 of the link information table 700. This 
generated index information is then stored at the front of the 
link information storage area in the transmission data hold- 
ing unit 113. 

The transmission data generating unit 112 reads the Lags 30 
in order from the start of the HTML document and interprets 
the tags by looking each tag up in the tag table to find the 
corresponding control operations. This interpretation of con- 
trol operation is performed by writing a character string 
detected after a tag start sign "<" one character at a time into 35 
the tag storage area provided in the work area until a tag end 
sign ">" is detected. The transmission data generating unit 
112 then matches the character string in the tag storage area 
with a tag written in the tag table. 

For tags which are not "<A>'\ "<IMG>*\ or "<character 40 
string preceded by '/*>", ihe transmission data generating 
unit 112 sets a flag showing the interpreted control operation 
in the flag storage area provided in the work area and stores 
the character strings between the start tag "<>" and the 
corresponding end tag "</>" into the character string storage 45 
area in the work area so as to correspond to the set flag. The 
storage of character strings between a pair of corresponding 
tags is performed in the same way as the storage of the 
character strings included inside the tags themselves. The 
transmission data generating unit 112 converts the character 50 
strings in the character string storage area into text image 
using the fonts in one of the font files and arranges the text 
image in accordance with the control operation represented 
by the current flag to generate display image information. 
This generated display image information is then added to 55 
the display image information storage area provided in the 
transmission data holding unit 113. Here, when a start tag 
"<character string>" is followed, not by a character string, 
but by another start tag "<another character string>", a flag 
is first set for the former tag in the flag storage area, before 60 
the processing is performed for the control operation indi- 
cated by the latter tag. 

If the read tag is "<IMG>'\ the transmission data gener- 
ating unit 112 fetches the image information file with the file 
name specified by the attribute "SRO" from the buffer of 65 
the information obtaining unit 111, and decompresses the 
image information file under the format specified by the file 
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name extension to convert the format of the image into an 
appropriate image data format, such as bitmap data or 
graphics data. 

If, for example, the file name extension is ".gif the 
transmission data generating unit 112 decompresses the 
image information file under GIF to convert the image 
information file into the appropriate format. If a preceding 
flag is set for a control operation to be performed on the 
converted image, the converted image is arranged in accor- 
dance with this control operation to generate display image 
information, otherwise the display image information is 
generated with the converted image being arranged in accor- 
dance with an initial setting. This generated display image 
information is then added to the display image information 
storage area. 

If the read tag is "<A>", the transmission data generating 
unit 112 checks to see if the "link destination file" specified 
by attribute "HREF=" of "<A> M is an audio file which has 
a file name extension, such as "au", which indicates audio 
information. If the link destination file is an audio file, the 
transmission data generating unit 112 fetches the audio file 
from the buffer of the information obtaining unit 111 and 
converts the audio information into audio data of a prede- 
termined format, before storing it in the audio information 
storage area. 

If the link destination file is not an audio file, the trans- 
mission data generating unit 112 generates a text image for 
the character string between tags <A>and </A>, and 
arranges the text image at a display position indicated by a 
preceding flag, or alternatively at a display position specified 
by an initial setting, with a space being reserved for dis-. 
playing a cursor. By doing so, the transmission data gener- . : 
a ting unit 112 generates display image information which is : 
then added to the display image information storage area 
provided in the transmission data holding unit 113. The 
transmission data generating unit 112 then calculates the 
X-Y coordinates for the space reserved for the cursor display 
position and refers to the hot spot information 702 in the link . : 
information table 700 to generate hot spot information from - 
the calculated X-Y coordinates and the "link destination file : ; 
name" specified by the attribute "HREF-" of tag "<A> M . In 
doing so, the transmission data generating unit 112 refers to 
the file list 200 and finds the serial number 201 correspond- 
ing to the file name in column 203 which in turn corresponds 
to the link destination file name of tag "<A>'\ before writing 
this serial number 201 into the hot spot information as the 
file identification number. If the link destination file name is 
not present in the file list 200, the transmission data gener- 
ating unit 112 writes the file name of the current file into the 
hot spot information. After doing so, the transmission data 
generating unit 112 adds the generated hot spot information 
to the link information storage area provided in the trans- 
mission data holding unit 113. 

After completing all of the above processes for an HTML 
document, the transmission data generating unit 112 writes 
a graphic representation of the identification number of the 
display image information area at a predetermined position 
in the non-displayed area of the display image information 
stored in the display image information area. In the present /. 
embodiment, the identification number has been described 
as being a four-figure decimal value, although the number of 
decimal digits is not limited to four. The identification 
number may alternatively be represented in binary notation, 
as a combination of numerals, characters and symbols, as a 
graphical figure, as a bar code, or even as a file name. Here, 
the audio information stored in the audio information stor- 
age area and the link information stored in the link infor- 
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mation storage area are also appended with the identification 
numbers of the corresponding storage areas, in the same way 
as with standard digital data files. 

Through the processes described above, the transmission 
data generating unit 112 generates a first, second, and third 5 
page of transmission data 800, 900, and 1000, which are 
respectively the first, second, and third pages of the home 
page provided by the WWW server, from the HTML docu- 
ment 301, the audio information not shown in the drawings, 
the image information 401, the HTML document 501, and 10 
the HTML document 601. 
Transmission Data Generated by 

The Transmission Data Generating Unit 112 

FIGS. 8Ato 8C show the transmission data 800 that is the 
first page of the home page provided by the WWW server. 15 
This first page of transmission data 800 has been generated 
from the HTML document 301, the audio information 
"Weather.au," and the image information 401. FIGS. 9A and 
9B show the transmission data 900 that is the second page 
of the home page provided by the WWW server which has 20 
been generated from the HTML document 501. FIGS. 10A 
and 10B show the third page of transmission data 1000 that 
is the third page of the home page which has been generated 
from the HTML document 601. As shown in FIGS. 8 A to 
8C, the transmission data 800 includes the display image 25 
information 801, the audio information 802, and the link 
information 803 which is related to display image informa- 
tion 801. Here, FIG. 8 A shows the display image which is 
the content of the display image information 801, FIG. 8B 
shows a representation of the content of the audio informa- 30 
tion 802, and FIG. 8C shows the content of the link 
information 803. 

In FIG. 8A, the area surrounded by the dotted line above 
the display image information 801 is a non-displayed area 
which is provided in each set of display image information. 35 
As its name suggests, this, non-displayed area is not dis- 
played on the screen of the display unit 154. An image of an 
identification number, such as "0001" shown in the drawing, 
is written into the top-right corner of the non-displayed area 
by the transmission data generating unit 112. The displayed 40 
area of display image information 801 is one display image 
which is composed of an image which was originally 
expressed as image information and character strings which 
have been converted from the original character code files 
into images. 45 

Hie audio information 802 is linked to the character string 
"AUDIO INFORMATION" which is a hot spot in the 
HTML document 301. Here, the file which includes the 
audio information 802 is also given the identification num- 
ber! "0001", as shown in FIG. 8B. 50 

The file storing the link information 803 is also given the 
identification number "0001", as shown in FIG. 8C. This 
link information 803 is used for control purposes, and is not 
displayed. "<INDEX«0001>" on line 811 of the link infor- 
mation 803 is the index information which indicates that the 55 
file identification number of the transmission data 800 is 
"0001". 

The character string on line 812 indicates that instruction 
"GO^_TO_PAGE(0002)" is related to a position in display 
image information 801 which is specified by the coordinates 60 
(100,600) and that a cursor image held by the data receiving 
apparatus 150 should be displayed at this position. Instruc- 
tion "GO_TO_PAGE(0002)" indicates that a page having 
identification number "0002", which in this case corre- 
sponds to the transmission data 900, should be displayed. 65 

The character string on line 813 indicates that the instruc- 
tion "GO_TO_PAGE(0003)" is related to a position in the 
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display image information 801 specified by the coordinates 
(100,700) and that a cursor image held by the data receiving 
apparatus 150 should be displayed at this position. This 
instruction "GO_TO_PAGE(0003)" indicates that a page 
having identification number "0003", which in this case 
corresponds to the transmission data 1000, should be dis- 
played. 

FIGS. 9A and 9B show the transmission data 900 which 
is the second page of the home page provided by the WWW 
server. This transmission data 900 includes the display . 
image information 901 and the link information 902, which 
is related to the display image information 901. Here, FIG. 
9 A shows the display image which is the content of the 
display image information 901 and FIG. 9B shows the 
content of the link information 902. 

As shown in FIG. 9A, an image of the identification 
number "0002" is written in the top-right comer of the. 
non-displayed area of the display image information 901 
which is shown by the dotted line, in the same way.as with 
the display image information 801. . 

As shown in FIG. 9B, the file storing link information 902 
is given the identification number "0002". 

In FIG. 9B, <INDEX«0002>on line 911 is the index .: 
information, indicating that the file identification number for 
transmission data 900 is "0002". 

The character string on line 912 indicates that the instruc- : 
tion "GO_TO_PAGE(0001) M is related to a position in the 
display image information 901 specified by coordinates 
(050,400) and that a cursor image held by the data receiving : 
apparatus 150. should be displayed at this position. Ibis 
instruction "GO„TO_PAGE(0001)" indicates that a page 
having identification number "0001," which in this case ' . 
corresponds to the, transmission data 800, should be dis- 
played. :. : v . '•.•.^••V-';;-"-- • ''' 

FIG. 10A and 10B show the transmission data 1000 which <\ 
is the third page of the home page provided by the WWW 
server. Transmission data 1000 includes display image infor- 
mation 1001 and link information 1002, which is related to : . 
display image information 1001. Here, FIG. 10A shows the 
display image which is the content of the display image 
information 1001 and FIG. 10B shows the content of the link ; ; ; 
information 1002. 

. As before, an image of the identification number "0003" ; 
is written into the top-right comer of the non-displayed area : 
of display image information 1001. 

As shown in FIG; 10B, the file storing link information 
1002 is given the identification number "0003". . 

"<INDEX«0003>" on line 1011 of the link information 
1002 is the index information, indicating that the identifi- : 
cation number of the files of the transmission data 1000 is 
"0003". 

The character string on line 1012 indicates that the 
instruction "GO_TO_PAGE(0001)" is related to a position 
in the display image information 901 specified by the 
coordinates (050,400) and that a cursor image should be 
displayed at this position. This instruction "GO_TO PAGE 
(0001)" indicates that a page having identification number 
"0001", which in this case corresponds to transmission data 
800, should be displayed. 

Illustrative Example of the Processing by the Information 
Obtaining Unit 111 and the Transmission Data Generating 
Unit 112 

The following is a specific example of the processing 
performed by the information obtaining unit HI and the 
transmission data generating unit 112 in which the files 
shown in FIGS. 3, 4, 5, and 6 are obtained and are used to 
generate the transmission data shown in FIGS. 8, 9, and 10. 
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Processing by the Information Obtaining Unit 111 

The information obtaining unit 111 first refers to the file 
list storing unit 121 and issues a connection request to the 
indicated WWW server on the Internet. The information 
obtaining unit I'll then obtains the HTML document 301 5 
"Report.html" from this WWW server, assigns it the file 
name "Report.html", and stores the file in the buffer. The 
information obtaining unit 111 also obtains the compressed 
image information 401, the HTML document 501, and the 
HTML document 601 in the same way from the WWW 10 
server. 

Processing by the Transmission Data Generating Unit 112 

The transmission data generating unit 112 allocates stor- 
age areas in the transmission data holding unit 113 for 
respectively storing the display image information 801, the 15 
audio information 802, and the link information 803 which 
compose the transmission data 800. In doing so, the trans- 
mission data generating unit 112 assigns the identification 
number "0001" for retrieving transmission data 800 to these 
storage areas. The transmission data generating unit 112 then 20 
fetches the (yet-unprocessed) HTML document 301 from 
the buffer of the information obtaining unit 111 and writes 
this document into the file storage area in the work area. 

The transmission data generating unit 112 then generates 
the index information "<INDEX-0001>" shown in line 811 25 
of the transmission data 800 for the first page of the WWW 
home page from the file name "Report. html" of HTML 
document 301, before storing the generated index informa- 
tion at the start of the link information storage area for link 
information 803 which is provided in the transmission data 30 
holding unit 113. 

The transmission data generating unit 112 then reads the 
tag "<HTML>" from line 311 in the HTML document 301 
and stores the character string "HTML" in the "<HTML>" 
tag in the tag storage area of the work area. It then refers to 35 
the tag table stored in the. data conversion table storing unit 
122 to interpret the tag, and by doing so recognizes that line 
311 is the first line of the HTML document 301. After doing 
so, it deletes the character string "HTML" from the tag 
storage area. 40 

Next, the transmission data generating unit 112 reads the 
tag "<H1>" on line 312 and refers to the tag table to interpret 
its content. On doing so, it sets the headline flag in the flag 
storage area in the work area. Here, the headline flag shows 
that the character string following the "<H1>" tag is a 45 
headline and so should be displayed using a headline font. 
The characters in the character string after the "<H1>" tag 
are then written one character at a time into the character 
string storage area until the "</Hl>" tag appears, which in 
the present case results in the character string "WEATHER 50 
REPORT" being written into the character string storage 
area and being converted into display image information 
using the headline font. This generated display image infor- 
mation is then added to the display image information 
storage area set in the transmission data holding unit 113. 55 
After this, the headline flag in the work area is reset, the 
character string "WEATHER REPORT* is deleted from the 
character string storage area, and the character string "HI" 
is deleted from the tag storage area. 

Next, the transmission data generating unit 112 reads the 60 
tag "<CENTER>" on line 313 and sets the centering flag in 
the work area. The centering flag shows that the character 
string which follows the corresponding tag is to be centered 
on the display. Here, there is no character string following 
the "<CENTER>" tag which can be centered, so that the 65 
transmission data generating unit 112 continues by reading 
line 314. 
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The transmission data generating unit 112 reads the tag 
'<IMG SRCVWeather.gif V on line 314 and refers to the 
tag table to interpret the content of the tag. The transmission 
data generating unit 112 then investigates whether the file 
for the image information 401, which is expressed by the file 
name "Weather.gif, is present in the buffer of the informa- 
tion obtaining unit 111, and, since this is the case, reads the 
file. The transmission data generating unit 112 then converts 
the image information 401 which is stored and compressed 
in the read file into a bitmap image or other such format, in 
accordance with a GIF decompression method. 

The transmission data generating unit 112 then reads the 
tag "</CENTER>" on line 315 and arranges the bitmap 
image converted from image information 401 in accordance 
with the centering flag set in the work area. The display 
image information thus generated is then added to the 
display image information storage area in the transmission 
data holding unit 113, before the centering flag in the work 
area is reset. 

The transmission data generating unit 112 then reads the 
"<P>" tag on line 316 and sets the paragraph flag. The 
paragraph flag shows that the character strings displayed 
between this start tag and the "</P" end tag should be 
displayed as a single paragraph which is to be inserted into 
the following blank line. As with "WEATHER REPORT' on 
line 312, the character string "TOMORROW, THE WHOLE 
OF JAPAN WILL ENJOY SPRINGLIKE WEATHER" 
between these tags is read and is stored in the character 
string storage area in the work area. Next, after reading the 
"</P>" tag, the transmission data generating unit 112 con- 
verts the character string "TOMORROW, THE WHOLE OF 
JAPAN WILL ENJOY SPRINGLIKE WEATHER" into an 
image using the font for paragraph display which is stored 
as one of the font files and adds the generated display image : 
information to the storage area in the transmission data 
holding unit 113 for display image information storage area 
801. After this, the content of the work area is cleared as 
before. 

The transmission data generating unit 112 next reads the 
tag "<UL>" on line 318, interprets it, and sets the itemized 
list flag in the work area. The itemized list flag shows that 
each character string which follows the tag and is interpreted 
as one item should be displayed as a non-numbered item in 
a list. 

The transmission data generating unit 112 next reads the 
tag "<L1>" on line 319, refers to the tag table, interprets the 
tag as indicating the start of one item in a list, and sets the 
item.flag in the flag storage area. The item flag shows that 
the display position on the display screen should be shifted 
to the next line every time an "<L1>" or "</Ll>" tag is read. 

The transmission data generating unit 112 reads the tag 
"<A HREF«"Tokyo.html>" following the tag "<L1>" and 
writes it into the tag storage area. The transmission data 
generating unit 112 then interprets this tag "<A HREF- 
"Tokyo.html>" and sets the link flag in the flag storage area. 

When the extension of the file name given as the attribute 
of the "<A>" tag indicates audio information, the link flag 
shows that processing for the audio information is to be 
performed so that the audio information is converted into a 
predetermined format and stored in the audio information 
storage area. When the extension of the file name given as 
the attribute of the "<A>" tag does not indicate audio 
information, the link flag shows that the character string 
between the "<A>" and "</A>" tags which is appended with 
the link by the "<A>" tags is to be converted into an image 
with a two-character space provided before it as a cursor 
display area. The link flag also shows that display image 
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information is to be generated for this character string in 
addition to hot spot information which is generated in 
accordance with the format of the hot spot information 702. 

The transmission data generating unit 112 reads the 
character string "TOKYO" between the "<A HREF« 5 
"Tokyo .html>" and "</A>" tags and writes it into the 
character string storage area. After reading the "</A>" tag, 
the transmission data generating unit 112 converts the char- 
acter string "TOKYO" into an image with a two-character 
space provided before it as a cursor display area and 10 
arranges the character string in accordance with the itemized 
list flag to generate display image information which it adds 
to the display image information storage area provided in the 
transmission data holding unit 113. The transmission data 
generating unit 112 men calculates the coordinates of the 15 
cursor display position as (100,600), and uses these coordi- 
nates and the attribute "Tokyo.html" stored in the tag storage 
area of the work area to generate the hot spot information 
shown on line 812 of FIG. 8. After doing so, the transmission 
data generating unit 112 adds the generated hot spot in for- 20 
mation to the link information storage area provided in the 
transmission data holding unit 113. Having done so, the 
transmission data generating unit 112 deletes the character 
string "AHREF="Tokyo.htmr in the tag storage area of the 
work area and the character string "TOKYO" in the char- 25 
acter string storage area, in addition to resetting the link flag. 

Next, on reading the "<L1>" tag on line 320, the trans- 
mission data generating unit 112 shifts the display position 
for the next display image to the following line in accor- 
dance with the item flag, and, in the same way as with line 30 
319, generates display image information for the character 
string "OSAKA", in addition to generating the hot spot 
information shown on line 813 of FIG. SC. The generated 
display image information is then added to the display image 
information storage area provided in the transmission data 35 
holding unit 113 and the generated hot spot information is 
added to the link information storage area. After this, the 
transmission data generating unit 112 deletes the character 
string "A HREF-"Osaka.html" and the character string 
"OSAKA", and resets the link flag. 40 

Next, on reading the "<L1>" tag on line 321, the trans- 
mission data generating unit 112 shifts the display position 
for the next display image to the following line in accor- 
dance with the item flag, and sets the link flag in accordance 
with the tag "A HREF="We ather.au". On investigating the 45 
file name extension of the attribute in accordance with the 
link flag, the transmission data generating unit 112 finds that 
the link, destination file is audio information in AU format, 
so that it converts the AU format audio information into 
audio information of a predetermined format, before storing 50 
the converted audio information in the audio information 
storage area provided in the transmission data holding unit 
113. 

Next, on reading the "</Ll>" tag on line 322, the trans- 
mission data generating unit 112 interprets that the itemized 55 
list is complete, and resets the itemized list flag and the item 
flag. 

Finally, on reading the "</HTML>" tag on line 323, the 
transmission data generating unit 112 interprets that the 
HTML document 301 has ended, and so terminates the 60 
generation process for transmission data 800. 

Following this, the transmission data generating unit 112 
finds that there is an unprocessed HTML document 501 and 
so sets a display image information storage area for display 
image information 901 and a link information storage area 65 
for link information 902 in the transmission data holding 
unit 113 for storing the composite parts of the transmission 
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data 900, in doing so giving both storage areas the identi- 
fication number "0002" for the retrieval of the transmission 
data 900. It then reads the unprocessed HTML document 
501 from the buffer of the information obtaining unit lli arid 
writes it into the work area. 

The transmission data generating unit 112 then generates 
the index information "<1NDEX=0002>" shown in line 911 
of the transmission data 900 which displays the second page 
of the WWW home page from the file name "Tokyo-html" 
of the HTML document 501, before storing the generated 
index information at the start of the link information storage 
area for the link information 902 which is provided in the 
transmission data holding unit 113. In the same way as with 
the generation of the transmission data 800 from the HTML 
document 301 and the image information 401, the transmis- 
sion data generating unit 112 then generates the transmission 
data 900 from the HTML document 501 and the transmis- 
sion data 1000 from the HTML document 601, with no 
further explanation of this process being given. 
Construction of the Transmission Data Holding Unit 113. 
the Transmission Data Reading Unit 114, the Multiplexing 
Unit 115, and the Transmitting Unit 116 

The transmission data holding unit 113 includes a display 
image information storing unit 123, an audio information 
storing unit 124, and a link information storing unit 125, 
with simultaneous retrieval from these units being possible. 

The display image information storing unit 123 can be 
realized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality of display image 
information storage areas which are set by the transmission 
data generating unit 112. Each of these display image 
information storage areas stores one file of display, image 
information which is generated by the fransmissioh daU 
generating unit 112. 

The audio information storing unit 124 can also be 
realized by RAM (Random Access Memory) or a hard disk 
device, and is provided with a plurality, of audio information 
storage areas which are set by the transmission data gener- 
ating unit 112. Each of these audio information storage areas 
stores one file of audio information which is generated by 
the transmission data generating unit 112.:; 

The link information storing unit 125 can also be realized 
by RAM (Random Access Memory) or a hard. disk device, 
and is provided with a plurality of link information storage 
areas which aire set by the transmission data generating unit 
112. Each of these link information storage areas stores one 
file of link ^formation which is generated by the transmis- 
sion data generating unit 112. 

The transmission data reading unit 114 simultaneously 
reads the display image information, the audio information, 
and the link information in a same transmission data file 
from the storage areas provided in the transmission data 
holding unit 113 in the order of the file : identification 
numbers for the transmission data, and outputs the read 
information to the multiplexing unit 115. After reading the 
files for the transmission data which has the final identifi- 
cation number, the transmission data reading unit 114 
returns to the transmission data with the identification num- 
ber 0001" and once again reads the transmission data in the 
order of the identification numbers. This is to say, the 
transmission data reading unit 114 cyclically, reads the 
transmission data from the transmission data holding unit 
113 in order of identification numbers and outputs the 
transmission data to the multiplexing unit 115. In doing so, 
there is the following difference in the reading method when 
audio information is or is not present. When no audio 
information is present, the transmission data reading unit 
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114 advances to the reading of a set of transmission data 
with the next identification number after reading a first set of 
transmission data once. When audio information is present, 
the transmission data reading unit 114 reads the audio 
information and advances to the reading of a set of trans- 
mission data with the next identification number only after 
reading the display image information and the. link infor- 
mation a plurality of times for the period which is required 
by the reproduction of the audio information. As one 
example, if the audio information has a reproduction period 
of two seconds, the transmission data reading unit 114 will 
read the audio information once, and will read the display 
image information and link information 60 times (30 frames 
per second*2 seconds), before advancing to the reading of a 
set transmission data with the next identification number. In 
this way, the transmission time for audio information can be 
maintained. 

The multiplexing unit 115 multiplexes the display image 
information (including the audio information) and the link 
information read by the transmission data reading unit 114, 
and outputs multiplexed data to the transmitting unit 116. 
Here, this multiplexing can be performed using the same 
method as conventional teletext broadcasting. In such a case, 
display image information and audio information are mul- 
tiplexed in the same way as the images and audio included 
in conventional TV broadcasts, while link information is 
multiplexed in the same way as the text information multi- 
plexed with teletext broadcasts. This is to say, when no audio 
iniformation is present, the display image information is 
transmitted in the image section of one frame of the televi- 
sion image signal, whilethe link information is transmitted 
in the retrace section of the same one frame of the television 
image signal. When audio information is present, the audio 
information is transmitted as the television audio. signal, 
while the corresponding display image information and link 
information are transmitted in the image area and retrace 
area, respectively, of the television image signal for the 
number of frames required by the reproduction of the audio 
information. ; 

The transmitting unit 116 successively transmits the trans- 
mission data which has been multiplexed by the multiplex- 
ing unit 115 on a TV broadcast ground wave. 
Transmission Method for the Transmission Data 

FIG. 11A gives a graphic representation of the transmis- 
sion method used by the transmitting unit 116. FIG. HA 
shows the case when n pages (n being a positive integer) of 
transmission data are generated by the transmission data 
generating unit 112. In FIG. 11 A, a pairing of audio infor- 
mation and display image information with a same identi- 
fication number is expressed as one transmission unit cor- 
responding to a normal TV broadcast, and the link 
information for the same identification number is expressed 
as one transmission unit corresponding to the text informa- 
tion which is multiplexed into a standard teletext broadcast. 

As shown in FIG. 11A, in addition to being identified by 
the same identification number, the display image 
information, audio information, and link information stored 
in one transmission data file are transmitted at a correspond- 
ing time. Also, the transmission data from the first to the nth 
page in the transmission data holding unit 113 are cyclically 
transmitted in the order of identification numbers. 

It should be noted here that while the transmission data 
reading unit 114 has been described as reading the display 
image information, the audio information, and the link 
information stored in the same transmission data file simul- 
taneously from the display image information storing unit 
123, the audio information storing unit 124, and the link 
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information storing unit 125 and as having the read display 
image information, audio information, and link information 
transmitted with related identification numbers and trans- 
mission timing, the display image information and the link 

5 information do not need to be transmitted with a related 
timing. As one example, the transmission data reading unit 
114 may instead be composed of a first reading unit and a . 
second reading unit. Here, the first reading unit is con- in- 
structed to continuously read pairs of display image infor- 
mation from the display image information storing unit 123 
and audio information from the audio information storing . 
unit 124 which it then outputs to the multiplexing unit 115. : 
The second reading unit is constructed to continuously read . 
only the link information from the link information storing 
unit 125 which it then outputs to the multiplexing unit 115. : 

15 By doing so, the display image information and link infor- 
mation belonging to a same transmission data file do not 
need to be transmitted by the transmitting unit 116 at the 
same time, since the data receiving apparatus 150 can use 
the identification number commonly given to the display 

20 image information and the link information to recombine 
pairs of the display image information and the link infor- 
mation. 

The multiplexing unit 115 has also been described as . 
multiplexing the display image information (including the 

25 audio information) and the link information which are 
generated by the transmission data generating unit 112, with 
the transmitting unit 116 transmitting the transmission data 
which has been multiplexed by the multiplexing unit 115 on : 
a TV broadcast ground wave, although the display image 

30 information and link information do not need to be multi- 
plexed together for transmission. As one example,: the dis- 
play image information and the audio information may be : : 
transmitted on a TV broadcast ground wave or as a digital; 
satellite broadcast; while the link information may be trans- 

35 mitted using a telephone link and modem, or the like. 
Transmission here may alternatively be performed using ' 
multiple channels. 

When digital satellite broadcasting is used as the data 
transmission method, compression/encryption and multi- 

40 plexing may be performed according to MPEG2 (Moving :; 
Pictures Experts Group) video standard and system 
standard, so that display image information may be set as I 
pictures, with the audio information and link information 
being set as private information. Here, when it is possible for 

45 the display image information, audio information, and link 
information to be transmitted as digital data, it is no longer 
necessary to write a graphic representation of the identifi- . 
cation number into the non-displayed area of the display 
image information, so that the identification number can be 

50 simply appended to the display image information and audio 
information, in the same way as with the link information. 
Incidentally, a detailed description of MPEG2 standard is 
given in "Saishin MPEG Kyoukasho [Latest MPEG 
Reader]" published by ASCII Publishing, Inc. 

55 FIG. 11B shows the multiplexed stream which is trans- 
mitted when digital satellite broadcasting is used. The upper 
part of this drawing shows a transport stream under MPEG2 
standard which has been generated by the multiplexing unit 
115. 

60 The symbols "VI, Al, LI" in the transport stream rep- 
resent the display image information, audio information, and 
link information which have the identification number 
"0001" and which are read from the transmission data file 
and multiplexed together. This is also the case for " V2, A2, 

65 L2** . . . u Vn, An, In". 

"VI" is a video elementary stream which shows the 
display image information which has been converted into I 
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(Intra) pictures under MPEG2 standard, with the PID information, and the transmitting unit 116 transmits the 
(Packet IDentifier) "0x0100" having been attached to iden- multiplexed transmission data using a television broadcast 
tify the stream. This is also the case for "V2" . . . "Vn". ground wave. 

"Al" is an audio elementary stream which shows the Procedure of the Information Obtaining Unit 111 
audio information which has been converted under MPEG2 5 FIG. 13 is a flowchart showing an example information 
standard, with the PID "0x0101" having been attached to obtaining procedure of the information obtaining unit 
identify the stream. This is also the case for "A2" . . . "An". The information obtaining unit 111 first refers to the file 

"Ll-Ln" are private sections according to MPEG2 stan- list in the file list storing unit 121 and checks whether there 
dard for attaching each set of link information, with the PID is any as-yet-unobtained information (step S1201). If there 
"OxBO" having been attached to identify these as private 10 is not, the information obtaining procedure is terminated. If 
sections. Here, identification numbers are also set in the there is, the file addresses (or URLs) of the as-yet- 
table ID extensions to identify separate sets of link infor- unobtained sets of information are fetched one at a time (step 
mation. Each of these sets of link information is set with at S1202). 

least one pairing of one part of the image area of the The information obtaining unit 111 then requests a con-., 
corresponding display image and information showing a link 15 nection with an external database, based on the fetched 
to another display image. As one example, in "Ll w , the address (step S1203), and checks whether the connection 
display area centered on the coordinates (X,Y)=(1 00,600) is has been successively established (step S1204). If the con- 
set with the link "GOTO_PAGE(O002)" representing a link nection is unsuccessful, the processing returns to step S12Q3 
to the display image with the identification number "0002", (step S 1204). 

while the display area centered on the coordinates (X,Y)» 20 If the connection has been , successful, the information 
(100,700) is set with the link "GOTO_PAGE(0003) M rep- obtaining unit 111 reads the file names of the as-yet- 
resenting a link to the display image with the identification unobtained information from the file list, obtains the corre- ; 
number "0003". sponding files from the external database, and stores them in 

The correspondence between the PIDs described above the internal buffer (step S1205). The processing then returns 
Q and the identification numbers is set according to the PMT 25 to step S1201. 

~Z (Program Map Table) under MPEG2 standard. Here, the Procedure of the Transmission Data Generating Unit 112 \., 

■ . correspondence between the PIDs and the identification FIG. 14 is a flowchart showing an example procedure for 

yp numbers can be written in the descriptors of the private generating transmission data by the transmission data gen- 

sections, such as by setting the identification numbers as the e rating unit 112. 
™ component tags in the PMT, as shown in FIG. 11B. 30 The transmission data generating unit 112 first refers to 

y * In the above case, the video elementary stream, audio the buffer in the information obtaining unit 111 and checks 

jpQ elementary stream, and private sections are generated by the whether any unprocessed HTML documents -exist (step 

C'i transmission data generating unit 112 and are stored in the S1301). If no such documents exist, the display image 

2!t transmission data holding unit 113. Here, a set of one video generating procedure is terminated. If there is such a 

fy elementary stream, one audio elementary stream, and one 35 document, the transmission data generating unit 112 estab- : 

3 private section stored in the transmission data holding unit . lishes the transmission data storage areas in the transmission 

f=j 113 corresponds to one transmission data file. Here, the data holding unit 113, assigns an identification number to 

^ video elementary stream, audio elementary stream, and each transmission data storage area, and then fetches an 

Sf private section stored as one set in the transmission data unprocessed HTML document from the buffer (step S1302). 

f\\ holding unit 113 are each read once, with the transmission 40 The transmission data generating unit 112 creates index 

~% data reading unit 114 cyclically reading all of the transmis- information indicative of the file name of the transmission 

^; ston data files. Using this data, transport streams are gener- data from the file name of the fetched HTML document, and 

O ated by the multiplexing unit 115. adds the index information to the link information storage 

As described above, by multiplexing n sets of display area established in the transmission data holding unit 113 

image information, audio in formation, and link information 45 (step S1303). 

with a PMT in the transport stream, transmission data can be One character is read from the fetched HTML document 
easily transmitted using digital satellite broadcasting. and is written into the character string storage area (step 

Overview of the Procedure of the S1304). 

Data Transmitting Apparatus 110 The transmission data generating unit 112 then checks 

The following is a detailed explanation of the procedure 50 whether the read character is a tag start sign (step 
of the data transmitting apparatus 110, with reference to S1305). If so, the processing advances to step S1307, or if 
FIGS. 12 to 14. not, the character is added to the character string storage area 

FIG. 12 is a' flowchart showing an overview of the in the work area, and the processing returns to step S1304 
procedure of the data transmitting apparatus 110. (step S1306). 

The information obtaining unit 111 obtains a desired set of 55 The next character is read (step S1307), and the trans- 
information from an external database and stores it in its mission data generating unit 112 judges whether the read 
internal buffer (step S1101). character is a tag end sign ">" (step S1308). If so, the 

The transmission data generating unit 112 interprets the processing advances to step S1310, or if not, the read 
information obtained by the information obtaining unit 111 character is added to the tag storage area in the working area,; 
and generates display image information, audio information, 60 before the processing returns to step S1307 (step S1309) 5 
and link information, which it stores in the transmission data The character string in the tag storage area is compared 
holding unit 113 (step SI 102). with the tag table, and a check is performed to see whether 

The transmission data reading unit 114 successively reads it starts with a T sign (step S1310). If it does, the trans- 
the transmission data from the transmission data holding mission data generating unit 112 judges whether the read tag 
unit 113 in order of identification numbers (step S1103) 65 is a "</HTML>" tag (step S1311). If so, the transmission 

The multiplexing unit 115 multiplexes the display image data generating unit 112 resets the work area, and the. 
information (including the audio information) with the link processing re rums to step S1310. If the read tag is not 



21 

"</HTML>" t the transmission data generating unit 112 
operates iri accordance with the least significant of the flags 
set in the flag storage area corresponding to this read tag, and 
resets the corresponding storage area in the work area (step 
S1312), before the processing returns to step S1304. 

In step S1310, when the character string does not start 
with "/"., a check is performed to see whether the read tag is 
"<IMG>" (step S1313). If so, the transmission data gener- 
ating unit 112 fetches the image information file specified by 
the attribute of the "<IMG>" tag from the buffer in the 
information obtaining unit 111 (step S1314). The fetched 
image information is converted in accordance with a GIF 
decompression method into image information expressed as 
bitmap data (step S1315), and the processing returns to step 
S1304. 

If the read tag is not "<IMG>", the character string in the 
tag storage area is compared with the content of the tag table 
and a flag corresponding to the tag is set in the flag storage 
area. The transmission data generating unit 112 then oper- 
ates in accordance with this tag (step S1316), before the 
processing returns to step S1304. 

A variety of tags can be employed in the HTML 
documents, and the processes represented by these tags can 
be performed in the same way as a conventional browser. 
Accordingly, the following explanation focuses on an 
example of the processing in step S1312 for the tag "</A>" 
which relates to the link information which generated in a 
special format for this data communication system 100. 

FIG. 15 is a flowchart showing a detailed example of the 
processing in step S 13 12 of FIG. 14 . 

The transmission data generating unit 112 first checks 
whether the read tag is "<A>" (step S1401), and if not, the 
processing advances to step S1408. 

If the read tag is "<A>", the transmission data generating 
unit 112 judges whether. the link destination file specified by 
the attribute is an audio information file (step S1402). If it 
is, the processing . advances to step S1407, or if not, the 
transmission data generating unit .112 generates display 
image information for the character string established in the 
character string storage area, in doing so leaving a display 
area for displaying a cursor design, before adding the 
generated display image mformatiori to the display image 
information storage area provided in the transmission data 
holding unit 113 (step S1403). . 

The transmission data generating unit 112 then calculates 
the X-Y coordinates which express the display position of 
the cursor design (step S1404). 

The transmission data generating unit 112 then generates 
hot spot information based on the calculated X-Y coordi- 
nates and the attribute established in the tag storage area, and 
adds it to the link information storage area provided in the 
transmission data holding unit 113 (step S1405). 

The transmission data generating unit 112 then resets the 
link flag in the work area, and deletes the character string in 
the tag storage area and the character-sequence storage area 
(step S1406). 

The transmission data generating unit 112 fetches an 
audio information file and converts the audio information 
contained in the file into information of a predetermined 
format which it stores in the audio information storage area ( 
(step S1407). 

The transmission data generating unit 112 operates in 
accordance with the read tag (step SI 408). 
Structure of the Data Receiving Apparatus 150 

The following is an explanation of the components of the 
data receiving apparatus 150, with reference to FIGS. 16 to 
20. 
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Structure of the Separating Unit 151 

The separating unit 151 includes a read buffer 161 for 
reading the identification number allotted to transmission 
data. The read buffer 161 has storage areas for temporarily 

5 holding the display image information (including audio 
information) included in one transmission file and the link 
information included in one transmission file. 

The separating unit 151 separates display image informa- 
tion (including audio information) and link information from 

10 the received transmission data, and stores the separated 
display image information and link information in the cor- 
responding storage areas of the read buffer 161. The iden- 
tification number assigned to the display image information 
stored in the storage area is read by recognizing the image 

15 written in the predetermined part of the non-displayed area . 
of the display image information. The identification number 
assigned to the link information is read in the same manner ■■ 
as when reading an identification number assigned to a . 
conventional digital data file. If the read identification num- 

20 ber is the identification number designated by the control ," ' 
unit 155, the display image information (including audio 
information) or the link information held by the read buffer 
161 is stored in the corresponding storage area in the 
received data holding unit 152, At this point, any audio 

25 information which is present is stored by the separating unit 
151 in a corresponding storage area provided in the received 
data holding unit 152 at the same time as the display image 
information is stored, so that the audio information is . 
gradually accumulated while the display image information ■'- 

30 with the identification number designated by the control unit 
155 is repetitively transmitted. By doing so, audio informal , 
tion which is transmitted across a plurality of frames can be 
separated from the transmission data. 

If the read identification number is not the identification ■'■ 

35 number designated by the control unit 155, the display 
image information (including audio information) or its link ; 
information held by the read buffer 161 is discarded. The \ 
reading of new display image information (including audio 
information) and link information is continued, and the; 

40 above procedure is repeated until the identification number V 
designated by the control unit 155 is detected. ■'[■■■ 
Structures of the Received Data Holding Unit 152, the ; 
Reproducing Unit 153, arid the Display Unit 

45 The received data holding unit 152 stores display image 
information (including audio information) and link informa- 
tion separated by the separating unit 151 linked with their 
assigned identification number. The storage area for storing 
the display image information can be achieved by RAM or . 

50 a hard disk device capable of storing one static image which 
is the size of the display screen. 

The reproducing unit 153 reproduces the display image : 
information stored in the received image holding unit 152 . 
along with the graphics information (described later) input - 

55 ted from the control unit 155, in accordance with an indi- 
cation which it receives from the control unit 155. The 
reproducing unit 153 outputs the reproduced image to the 
display unit 154. The reproducing unit 153 also reproduces 
the stored audio information in synchronization with the : 

60 reproduction display image information and outputs the 
reproduced audio to the audio output unit 157. 

The display unit 154 can be realized by a television 
monitor which displays images according to NTSC 
(National Television System Committee) standard, and is 

65 used to display the display image and cursor design on its 
screen, in accordance with the input from the reproducing 
unit 153. 
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Structure of the Control Unit 155 

The control unit 155 sets an initial value in the register 
storing a variable (described later), and instructs the sepa- 
rating unit 151 to fetch the display image information 
(including audio information) and link information of a page 5 
specified by this initial value, which as one example can be 
the identification number "0001". 

The control unit 155 instructs the reproducing unit 153 to 
reproduce the display image information (including audio 
information), every time new display image information 10 
(including audio information) is stored in the received data 
holding unit 152. Every time new link information is stored 
in the received data holding unit 152, the control unit 155 
interprets the link information and generates a cursor design 
correspondence table in which cursor designs (described 15 
later) are generated for each cursor display position. These 
cursor designs are expressed by cursor information which is 
held inside the control unit 155. The control unit 155 outputs 
design information expressing a cursor design together with 
the cursor position to the reproducing unit 153, as well as 20 
indicating the reproduction of the cursor design. 

FIG. 16 shows an example of the cursor design corre- 
spondence table which the control unit 155 generates to 
control the display position of the cursor design. 

The cursor design correspondence table shows the corre- 25 
spondence between each cursor display position which is 
expressed in the hot spot information in the link information 
stored in the received data holding unit 152 and the cursor 
number for the cursor design to be displayed at each cursor 
display position. The control unit 155 assigns cursor num- 30 
bers to each cursor display position in the link information 
in order of lowest Y coordinate and then lowest X 
coordinate, as one example, and writes each display position 
into the item with corresponding cursor number in the cursor 
design correspondence table. 35 

FIG. 17 shows an example of the design information 
stored by the control unit 155. As shown in FIG. 17, the 
control unit 155 stores cursor information which expresses 
a cursor design for each cursor number when the number is 
selected (referred to as the "selection state") and a cursor 40 
design for each number when the number is not selected 
(referred to as the "non-selection state"). 

On receiving an interrupt from the signal receiving unit 
156, the control unit 155 interprets the type of input signal 
stored in the signal receiving unit 156, selects the design 45 
information of the corresponding cursor design, and outputs 
the cursor information to the reproducing unit 153. Follow- 
ing this, the control unit 155 controls the handling of the 
received data by the separating unit 151, in accordance with 
the cursor whose selection has been confirmed. 50 
Display Control Procedure for the Received Data 

The following is a detailed explanation of the display 
control procedure by the control unit 155 for a set of 
received data, a set of received data referring to display 
image information (including audio information) and link 55 
information which have been stored in corresponding stor- 
age areas in the received data holding unit 152 by the 
separating unit 151 and which have the same identification 
number. 

The control unit 155 sets a predetermined value, such as 60 
"1", into the variable "P-Index" which expresses the iden- 
tification number of the received data to be displayed. The 
control unit 155 then sets a predetermined value, such as 
"1", into the variable "Cur-Pos" showing the cursor number 
which is in the selection state. Following this, the control 65 
unit 155 instructs the separating unit 151 to obtain the 
transmission data indicated by the variable P-Index". The 
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control unit 155 then interprets the link information in the . 
received data which is received in accordance with this 
instruction and is stored in the received data holding unit . 
152, and outputs the cursor information for each cursor, the .. 
cursor indicated by the variable Cur-Pos being in the selec- . 
tion state, together with the display position to the repro- 
ducing unit 153. Here, when an interrupt from the signal ' 
receiving unit 156 occurs, the control unit 155 interprets the 
control signal stored in the signal receiving unit 156. First, 
the control unit 155 checks whether the input signal was 
"Up", in which case the control unit 155 decreases the value ■; 
of variable Cur-Pos by 1. If not, the control unit 155 checks 
whether the input signal was "Down", in which case the .;: 
control unit 155 increases the value of variable Cur-Pos by 
1. If not, the control unit 155 checks whether the input signal : 
was "Enter", in which case the control unit 155 finds the 
coordinates of the display position from the cursor number 
given by the variable Cur-Pos, and obtains the identification 
number of the file which is the link destination file written 
in the hot spot information for these coordinates. The control 
unit 155 then sets this identification number in the variable ■. 
P-Index, and instructs the separating unit 151 to obtain the > 
transmission data shown by the variable P-Index. 
Structure of the Signal Receiving Unit 156 and the Audio 
Output Unit 157 

On receiving an input signal from a remote controller : 
(not-illustrated) or the like, the signal receiving unit 156 : 
creates an interrupt for the control unit 155 in accordance: 
with the received input signal, as well as holding the 
received input signal. 

The audio output unit 157 can be realized by a speaker or 
the like, and is used to output the reproduced audio infor- 
mation as audio. 
Example of a Display Image 

FIG. 18 shows display image 1800 for the initial screen; 
which is displayed by the display unit 154 based on the; 
transmission data 800 shown in FIGS. 8A to 8C. , 

As shown in FIG. 18, the display image 1800 has the ;: 
cursor design 1801 corresponding to cursor number "1" 
displayed at a display position (100,600) indicated by the ; r 
display image information 801, in accordance with the hot : 
spot information given on line 812 of the link information ;: 
803. It should be noted here that the cursor information ! 
which represents the selection state has been selected for 
cursor design 1801 in accordance with the initial value of the 
variable Cur-Pos which is held by the control unit 155. 

In the same way, the cursor design 1801 corresponding to 
cursor number "2" is displayed at a display position (100, 
700), in accordance with the hot spot information given on - 
line 813 of the link information 803. It should be noted here; : 
that the cursor information which represents the non- . 
selection slate has been selected for cursor design 1802 since . 
its cursor number "2" does not coincide with the initial value 
of the variable Cur-Pos. 

Here, since the transmission data 800 includes audio 
information 802 in additioa to the display image information :: 
801, an audio commentary is outputted by the audio output : 
unit 157 when the display image 1800 is displayed on the 
display unit 154. 

FIG. 19 shows the display image 1900 which is the initial . 
screen displayed by the display unit 154 for the transmission 
data 900 shown in FIGS. 9A and 9B. 

As with the display image 1800 in FIG. 18, the display 
image 1900 has the cursor design 1901 displayed at a display 
position (050,400) indicated by the display image informa-; 
tion 901, in accordance with the hot spot information given - 
on line 912 of the link information 902. Here, the cursor ;; 
information for the selection state is selected as cursor 
design 1901. 
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FIG. 20 shows the display image 2000 which is the initial 
screen displayed by the display unit 154 for the transmission 
data 1000 shown in FIG. 10A and 10B. 

As before, the display image 2000 has the cursor design 
2001, which corresponds to cursor number "1" and which 5 
shows the selection state, displayed at a display position 
(050,400) indicated by the display image information 1001, 
in accordance with the hot spot information given on line 
1012 of the link information 1002. 

Specific Example of the Procedure of the Control Unit 155 10 

The following is an explanation of a specific example of 
the procedure executed by the control unit 155 when dis- 
playing the display image 1800 on the display unit 154 based 
on the transmission data 800. 

The control unit 155 first sets the initial value of the 15 
variable P-Index at "0001" and the initial value of the 
variable Cur-Pos at "1". Next, the control unit 155 instructs 
the separating unit 151 to obtain the display image infor- 
mation 801 (including the audio information 802) and the 
link information 803 which have the identification number 20 
"0001" set in the variable P-Index. The control unit 155 then 
instructs the reproducing unit 153 to reproduce the display 
image information 801 (including audio information 802) 
stored in the received data holding unit 152. The reproduc- 
ing unit 153 reproduces the display image information 801 25 
and outputs it to the display unit 154 and simultaneously 
reproduces the audio information 802 which it outputs to the 
audio output unit 157. The control unit 155 interprets the 
link information 803 stored in the received data holding unit 
152, generates a cursor design correspondence table, and 30 
outputs design information for each cursor and their display 
positions to the reproducing unit 153. At this point, the 
cursor indicated by the variable Cur-Pos, which is to say the 
first cursor, is displayed in the selection state. 

The control unit 155 then waits for an input from the 35 
■signal receiving unit 156. Here, suppose that a "Down" 
: signal is inputted into the signal receiving unit 156 from an 
external remote controller. When the input signal is "Down", 
the control unit 155 increases the value of variable Cur-Pos 
by "1", making it "2". Next, the cursor information for the 40 
selection state is selected as the design for cursor number 
"2" which is indicated by this updated variable Cur-Pos, and 
the cursor information for the non-selection state is selected 
as the design for cursor number "1" which was formerly 
indicated by the variable Cur-Pos, with these sets of cursor 45 
information being outputted to the reproducing unit 153. 

The control unit 155 waits for an interrupt from the signal 
receiving unit 156, with the following explanation describ- 
ing the case when the signal receiving unit 156 stores an 
input signal for a pressing of the " Enter" key after generating 50 
the interrupt. If the input signal is "Enter", the control unit 
155 reads the X-Y coordinates (100,700) corresponding to 
cursor number "2" which is indicated by the variable Cur- 
Pos from the cursor design correspondence table. Next, the 
control unit 155 reads the identification number of the link 55 
destination file of the hot spot information on line 813, based 
on these X-Y coordinates (100,700), and obtains the iden- 
tification number "0003". Next, this identification number 
"0003" is set as the value of the variable P-Index. Following 
this, the control unit 155 instructs the separating unit 151 to 60 
obtain the display image information 1001 and the link 
information 1002 which have the identification number 
indicated by this variable P-Index. The control unit 155 then 
resets the variable Cur-Pos to "1". 

By repeating the processing described above, the display 65 
image 2000 shown in FIG. 20 can be displayed on the 
display unit 154. Here, if an interrupt occurs when the value 
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of the variable Cur-Pos is "1", and an input signal for 
"Enter" is being stored by the signal receiving unit 156 when 
the control unit 155 refers to the signal receiving unit 156, 
the control unit 155 will have the display image 1900 shown 
in FIG. 19 displayed on the display unit 154, as described 
above. 

Procedure for Display Control 

FIG. 21 is a flowchart showing an example procedure for 
display control which is performed by the control unit 155. 

The control unit 155 first sets the initial value of the 
variable P-Index which indicates the identification number 
of the transmission data to be obtained (step 

The control unit 155 then sets the initial value of the 
variable Cur-Pos which indicates the cursor number of the 
cursor in the selection state for the start of display of each 
display screen (step S2102). 

The control unit 155 then instructs the separating unit 151 
to obtain the transmission data which has the identification 
number indicated by the variable P-Index. The separating 
unit 151 then separates the display image information and 
link information in accordance with the indication from the 
control unit 155, and stores the display image information 
and link information with their identification number in the 
received data holding unit 152 (step S2103). 

On being instructed by the control unit 155, the repro- 
ducing unit 153 reproduces the display image information in 
the received data holding unit 152 and outputs it to the 
display unit 154. When there is audio information which is 
related to the display image information, the reproducing 
unit 153 reproduces this audio information and outputs it to 
the audio output unit 157 (S2104). 

The control unit 155 interprets the link information in the 
received data holding unit 152 and outputs the design 
information for the cursor designs together with the X-Y 
coordinates for the display positions of the cursors, as well 
as an instruction to display the design information to the 
reproducing unit 153. The reproducing unit 153 reproduces 
the design information inputted from the control unit 155 
and outputs it to the display unit 154 (step S2105). By doing 
so, one display image is displayed by the display unit 154. 

The control unit 155 waits for an interrupt from the signal 
receiving unit 156 (step S2106), and on receiving an 
interrupt, checks whether the input signal held by the signal 
receiving unit 156 is "Up" (step S2107). 

If the input signal is "Up", the control unit 155 subtracts 
"1" from the value of the variable Cur-Pos (step S2108). If 
not, the control unit 155 checks whether the input signal held 
by the signal receiving unit 156 is "Down" (step S2109). 

If the input signal is "Down", the control unit adds "1" to 
the value of the variable Cur-Pos (step S2110). If not, the 
control unit 155 checks whether the input signal held by the 
signal receiving unit 156 is "Enter" (step S2U1) 

If the input signal in "Enter", the control unit 155 uses the 
cursor number shown by the variable Cur-Pos to reference 
the cursor design correspondence table and so finds the 
cursor display position (X,Y) whieff it then uses to find the 
value of the identification number of the link destination file 
in the hot spot information. The control unit 155 then sets 
this identification number as the value of the variable 
P-Index. After this, the processing returns to S2102. 

If the input signal is not "Enter", the processing returns to 
S2106. 

As described above, in the present embodiment the dis- 
play image information, which conventionally would have 
had to have been generated by the data receiving apparatus 
150 while the data receiving apparatus 150 is interpreting 
the control information, is generated and transmitted by the 
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data transmitting apparatus 110, which reduces the load of 
each data receiving apparatus 150. Also, when compared 
with the large number and variety of display control pro- 
cesses for display character strings which were convention- 
ally written into the control information, the link informa- 5 
tion of the present embodiment contains a smaller number 
and less variety of control processes. As a result, simulated 
bidirectional communication can be easily achieved by the 
data receiving apparatuses 150 using this link information. 

The present embodiment describes the case when in order 
to display WWW. home pages on the Internet, the data 10 
communication system 100 uses a one-to-many TV broad- 
cast to perform simulated bidirectional communication, so 
that when compared to the case when home pages are 
displayed by a browser on a personal computer, the display 
of the user's desired pages on the display unit 154 can be 15 
performed at a high speed which is unaffected by conges- 
tion. Since display image information is sent in a conven- 
tional TV format, the display of full color, high-resolution 
images can easily be achieved by the display unit 154. Also, 
while the display of display images generated by a browser 20 
for display on a TV monitor does not make full use of the 
components, such as the reproduction processing for display 
images, conventionally provided inside a TV, the present 
embodiment can achieve simulated bidirectional communi- 
cation which makes full use of circuitry, such as memory 25 
and decoders, conventionally provided inside a TV set 

In the present embodiment, while the information to be 
obtained has been described as HTML documents which are 
used on the WWW together with compressed image infor- 
mation in GIF format and audio information in AU format, 30 
information expressed in other formats or languages, such as 
HyperCards, can be used. In such case, the processing for 
"<A>" tags refer to a method for conversion for the corre- 
sponding format and language. The present embodiment : 
also describes the conversion of an HTML document con- 35 
taining only a limited number of tags, although other HTML 
tags may also be included. 

The present embodiment also describes an example where 
the control for simulated bidirectional communication per- 
formed according to the link information is the switching of 40 
the display to another display image, although other 
processes, such as a process for flashing display on the 
screen, a process for scrolling the display image, or a process 
for activatinjg a device such as a fax, telephone, or video 
recorder connected to the data receiving apparatus, may be 45 
performed in addition to simulated bidirectional communi- 
cation. 

The data communication system 100 is also described as 
having identification numbers of files written into the link 
information by the transmission data generating unit 112, 50 
although this process heed not to be performed. As one 
alternative, the original file name may be written into the 
link information as the file identification number. When 
doing so, the file name can be attached to the display image 
information (including audio information) and link informa- 55 
tioQ in each set of transmission data during transmission, 
with the data receiving apparatus 150 which receives this 
information successively obtaining a complete set of link 
information after being switched on, so that it can then 
investigate the correspondence between .file names and 60 
identification numbers. 

The data receiving apparatus 150 may also store a com- 
plete set of display image information and link information 
which are repeatedly transmitted by the data transmitting 
apparatus 110 in the received data holding unit 152. 65 

When the transport stream shown in FIG. 11B is trans- 
mitted from the data transmitting apparatus 110, the receiv- 
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ing apparatus 150 may first have the separating unit 151 
separate and obtain the PMT, before reading the PMT to find 
the PID of the display image information to be obtained and 
having the display image information separated and 
obtained from the transport stream with the read PID as a 
filter condition. It may also read the PID of the private 
stream including the link information from the PMT, and 
then separate and obtain the link information from the 
transport stream with the PID and the identification number 
(table ID extension) as the filter conditions. 

The transport stream shown in FIG. 11B was also, 
described as having a video elementary stream made up of 
I pictures, although the video elementary stream may 
include B pictures and P Pictures. The display image infor- 
mation was also described as being encoded according to 
MPEG2 standard, although it may alternatively.be encoded 
under another standard, such as MPEG1, JPEG, or GIF. 
Finally, the display image information and audio informa-. 
tion were described as being transmitted as a video elemen- . 
tary stream and an audio elementary stream, although they 
may be multiplexed as private sections in the same way as 
the link information. 
Second Embodiment 

FIG. 22 shows the construction of the data conversion 
apparatus in the second embodiment of the present invention 
used in a data communication system. Note that the con- 
struction of the data communication system is the same as 
that of the first embodiment. 

The data conversion apparatus includes information 
obtaining unit 2201, data conversion table storing unit 2202, 
cursor design storing unit 2203, temporary document stor- 
age unit 2204, controlling unit 2205, image generating unit : 
2206, link information generating unit 2207, and temporary . 
information storage unit 2208. 

The data conversion apparatus of the jpresent embodiment 
is equal to information obtaining unit 111 and transmission 
data generating unit 112 of the first embodiment. Informa- 
tion obtaining unit 2201 is connected to an external 
database, and controlling unit 2205 is connected to trans- : 
mission data holding unit 1103. 

In the first embodiment, the cursor designs are expressed 
by cursor information which is held inside the control unit 
155 of data receiving apparatus 150. In the second 
embodiment, however, the cursor designs are included in 
image information and transmitted from transmitting unit 
116 of data transmitting apparatus 110. 

Information obtaining unit 2201 obtains multimedia data 
from the external database and stores the obtained data. The . 
multimedia data, for example, includes HTML documents 
2301 and 2401 and image 2501 as shown in FIG. 25, where 
image 2501 is compressed under GIF format. . 

HTML documents 2301 and 2401 and image 2501 are not 
described here since they have already been described in the : 
first embodiment. FIGS. 26 and 27 show HTML document 
2301 and image 2501 displayed by a conventional WWW 
browser on display screen 2601 of a personal computer 
having a resolution of 640x480 dots (pixels). Document 
2301 is displayed as an image over two screens, namely 
consecutive display images 2602 and 2701. The two display 
images can be scrolled in the vertical direction by operating 
on scroll buttons 2603 and 2604 which are respectively 
displayed on the upper-right and lower-right, comers of the . 
screen. 

Data conversion table storing unit 2202 has a data con- 
version table for converting a multimedia document, which 
has been read from information obtaining unit 2201, into the 
data format suitable for transmission data holding unit 113. 
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The data conversion table includes a tag table (not shown in 
the drawings), font table 2801 as shown in FIG. 28, and link 
information conversion table 2901 as shown in FIG. 29. 

The tag table stores information used for interpreting the 
tags included in HTML document 2361 as shown in FIG. 23, 5 
where HTML documents are written in HTML The tag table 
has already been described in the first embodiment with 
reference to FIGS. 2 and 4. 

Font table 2801 includes the x-y coordinates of starting 
point 2803 of a character string which corresponds to tag 10 
2802 in HTML document 2301. Font table 2801 also 
includes font size 2804 for the character string. The x-y 
coordinates and font size 2804 are represented by pixels. 

Link information conversion table 2901 includes conver- 
sion information 2902 and 2903 for generating the link 15 
information. Conversion information 2902 indicates that 
"file name" in HTML document 2301 should be converted 
to "Index file name." 

Conversion information 2903 indicates that tag 
<A>including "file name" as a link destination should be 20 
converted to "Hotspot(M file name)/' where "M" is a 
number corresponding to the number of conversions. 

Cursor design storing unit 2203 stores cursor design table 
3001 as shown in FIG. 30. Cursor design table 3001 includes 
columns for index number 3002 and cursor design 3003. 25 
Index number 3002 is assigned to each of the HTML 
documents linked to an HTML document. In the present 
embodiment, seven HTML documents are linked to HTML 
document 2301. Cursor design 3003 is displayed at the front 
of a hot spot indicating a link destination. The numeral 30 
included in cursor design 303 matches corresponding index 
number 302. 

Temporary document storage unit 2204 stores a document 
among the documents stored in information obtaining unit 
2201 and an image. Temporary document storage unit 2204 35 
stores, for example, HTML document 2301 as shown in 
FIG. 23 and image 2501 as shown in FIG. 25. 

Controlling unit 2205, on receiving from an external unit 
an instruction for generating reproduction information, reads 
a document from information obtaining unit 2201, stores the 40 
document in temporary document storage unit 2204, and 
activates image generating unit 2206 and link information 
generating unit 2207. Controlling unit 2205, on . receiving 
from image generating unit 2206 an instruction for writing 
data into transmission data holding unit 113, reads an image 45 
from the image storage area of temporary information 
storage unit 2208, writes the image into display image 
storing unit 123, reads a piece of link information from the 
link information storage area, and writes the piece of link 
information into link information storing unit 125. In this 50 
process, the same identification number is given to both the 
image and the piece of link information so that both are 
identified as a pair. 

Controlling unit 2205, on receiving an instruction for 
storing an image specified by image generating unit 2206 55 
into temporary document storage unit 2204, reads the speci- 
fied image and stores the image into temporary document 
storage unit 2204. 

Image generating unit 2206, when activated by control- 
ling unit 2205, allocates an image storage area in temporary 60 
information storage unit 2208 for storing an image with the 
size of a screen, then allocates a link information storage 
area related to this image storage area. 

Image generating unit 2206, after allocating the image 
storage area in temporary information storage unit 2208, 65 
reads a tag table (not shown in the drawings) and font table 
2801 from data conversion table storing unit 2202, and 
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converts character strings and images of the document 
stored in temporary document storage unit 2204 into an 
image to be displayed. The process of the conversion has 
been described in the first embodiment in relation to trans- 
mission data generating unit 112. 

Image generating unit 2206, on reading tag <IMG>2304, ;■ 
instructs controlling unit 2205 to fetch image file "Weath- 
er.gif * into temporary document storage unit 2204. 

Image generating unit 2206, on reading tag <A>2305, 
notifies link information generating unit 2207 of the fil? ■ 
name as a link destination. Image generating unit 2206, on 
receiving an "M" value from link information generating ' 
unit 2207, obtains a cursor design 3003 corresponding to the 
"M" value (index number) by referring to cursor design 
table 3001. Image generating unit 2206 then calculates ; 
coordinate values (Xst,Yst) of a display position of the 
display element (character string or image) of the HTML 
document, which is also used as a cursor position. The 
coordinate values (Xst,Yst) indicate a point at the upper-left : 
corner of the display element block. Value Xst is determined 
as "10" from x-10 included in font table 2801, "X" indi^ 
eating the starting position of tag <L1>. Value Yst is 
obtained by adding up the number of pixels in Y-coordinate . 
direction before the tag <A>. 

For character string "OSAKA" included in tag <A>2305 / 
as shown in FIG. 23, Xst-0 and Yst=10+80+(270)+60«420, 
where the numeral in parentheses "( )" indicates the number 
of pixels in Y-coordinate direction of image file "Weath- 
er.gif" as a display image. Note that the image file "Weath- ,. 
er.gif* as a display image is 360x270 pixels in size. 
Accordingly, coordinate values (Xst,Yst) are calculated as : 
(10,420). 

Image generating unit 2206 writes the obtained cursor - 
design 3003 at the start of (Xst,Yst) in the image storage area ■■; ;.■.:->; 
in temporary information storage unit 2208, then writes a ■ 
character string after the cursor design. FIG. 31 shows image 
information 3102 which is generated from HTML document x v 
2301 as shown in FIG. 23 and is stored in image storage area 
3101. 

Image generating unit 2206, when image information : 
3102 is written into image storage area 3101, newly assigns 
only image storage area 3201 (see FIG. 32) in temporary 
information storage unit 2208. Image generating unit 2206 . 
then analyzes HTML document 2301 and writes me image 
into image storage area 2301. Image generating unit 2206, 
on recognizing that HTML document 2301 has been 
analyzed, instructs controlling unit 2205 to write data into ' .;. 
transmission data holding unit 113. 

Link information generating unit 2207, when activated by 
controlling unit 2205, reads a file name of a file stored in 
temporary document storage unit 2204, such as 
"Report.html," by referring to link information conversion : 
table 2901 of data conversion table storing unit 2202. 

Link information generating unit 2207 sets counter M, 
which is used as index number 3002, to "1" when "file 
name" is converted into "index(file name)." Link informa- 
tion generating unit 2207, on receiving the contents of tag 
<A>2305 from image generating unit 2206, sends the value 
of counter M to image generating unit 2206, generates a 
piece of link information according to conversion informa- 
tion 2903 in link information conversion table 2901, stores 
the generated piece of link information in the linkiinforma- 
tion storage area in temporary information storage unit .- 
2208, and increments the value of counter M. After this, the v- 
value of counter M, or index number 3002, is inserted at the \ 
front of the file name in the piece of link information. 

Temporary information storage unit 2208 temporarily 
stores the image generated by image generating unit 2206 
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and the piece of link information generated by link infor- 
mation generating unit 2207. FIGS. 31 and 32 show images 
3101 and 3102 generated from HTML document 2301 as 
shown in FIG. 23. FIG. 33 shows link information 3301 
which commonly corresponds to images 3102 and 3202. 5 

Now, the operation of the present embodiment is 
described with reference to the flowchart of FIG. 34. 

When controlling unit 2205 receives an instruction for 
generating an image from ah external element, image gen- 
erating unit 2206 allocates an image storage area and a link 10 
information storage area in temporary information storage 
unit 2208 for storing an image with the size of a screen 
(S3402). 

Image generating unit 2206 then judges whether an 
unanalyzed HTML document is stored in temporary docu- 15 
ment storage unit 2204 (S3404). If stored, image generating 
unit 2206 analyzes the HTML document (S3406); if not, 
controlling unit 2205 reads image information and link 
information from temporary information storage unit 2208, 
writes them into transmission data holding unit 113 as a pair, 20 
and ends processing. 

Image generating unit 2206 judges whether the analyzed 
HTML document is link information (control information 
including tag <A>) (S3408). If it is, image generating unit 
2206 obtains a certain cursor design from cursor design 25 
storing unit 2203 (S3410); if not, control goes to S3412. At 
S3412, image generating unit 2206 calculates a display 
position of the display element in the HTML document 
(S3412), and places the display element at the display 
position. If it is judged that the HTML document is link 30 
information at S3408, image generating unit 2206 inserts the 
cursor design at - the display position before the display 
element, and link information generating unit 2207 writes 
link information into the link information, storage area 
(S3414). Image generating unit 2206 judges whether the 35 
image storage area has a space for storing another display 
element (S3416). If it has, control returns to S3401; if it does 
not, image generating unit 2206 assigns only the image 
storage area in temporary -information storage unit 2208 
(S3418), and control returns to S3404. 40 
Third Embodiment 

FIG. 35 shows the construction of the data conversion 
apparatus in the third embodiment of the present invention 
used in a data communication system. The data conversion 
apparatus includes information obtaining unit 2201, data 45 
conversion table storing unit 2202, cursor design storing unit 
2203, apparatus information storing unit 3501, temporary 
document storage unit 2204, controlling unit 2205, image 
generating unit 3502, link information generating unit 3503, 
and temporary information storage unit 2208. Of these, the 50 
same elements as those of the second embodiment are not 
described here. The following is a description of the ele- 
ments unique to the third embodiment. 

FIG. 36 shows remote controller 3601 for transmitting 
signals to signal receiving unit 156, which has been 55 
described in the first embodiment. Remote controller 3601 
includes 12 numeral buttons. Of these, six buttons "1" to "6" 
are used for specifying a cursor design. 

Apparatus information storing unit 3501 stores "k," which 
represents the maximum number of cursor designs that can 60 
be displayed in one screen, where the cursor designs are 
used to identify link destination files. In the present 
embodiment, k is "6" since six buttons are used for speci- 
fying the cursor designs. 

Controlling unit 2205 notifies image generating unit 3502 65 
and link information generating unit 3503 of a completion of 
writing when controlling unit 2205 has written an image and 
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a piece of link information into display image information 
storing unit 123 and Slink information storing unit 125 
respectively. Controlling unit 2205 also includes the func- 
tions described in the second embodiment. 

Image generating unit 3502 recognizes the number of tags 
<A>in HTML document 2301 from the value of counter M 
sent from link information generating unit 3503. Image 
generating unit 3502 also includes the functions of image 
generating unit 2206 described in the second embodiment. 
FIG. 37 shows image 3701 which is obtained by converting 
image file "Weatber.gif ' in HTML document 2301 into a 
display image, image 3701 being 360x210 pixels in size. 
Image generating unit 3502, after generating an image for 
one screen, instructs controlling unit 2205 to write the image 
into transmission data holding unit 113. 

Image generating unit 3502 judges whether the value of 
counter M, which is sent from link information generating 
unit 3503, matches the value of k in apparatus information 
storing unit 3501. When they match, image generating unit 

3502 writes the corresponding cursor design and the display 
element into temporary information storage unit 2208, then 
instructs controlling unit 2205 to write the cursor design and 
the display element into transmission data holding unit 113. 
In this way, image 3801 as shown in FIG. 38 is generated, 
where the number of pieces of link information does not 
exceed k in apparatus information storing unit 3501. 

FIG. 39 shows image 3901 which is generated by con- 
verting the display element in HTML document 2301 into a 
display image. 

Link information generating unit 3503 includes the func- 
tions of link information generating unit 2207 described in 
the second embodiment. Link information generating unit 

3503 also includes following functions unique to the present 
embodiment. Link information generating unit 3503, on 
being activated by controlling unit 2205, sets counter N to 
"0." Link information generating unit 3503, on receiving a 
notification of a completion of writing from controlling unit 
2205, adds "I" to counter N. When counter N has a value 
other than "0," link information generating unit 3503 
changes the link information to "Index ("ReportN.htm")." 
Link information generating unit 3503 sets counter M to "1" 
when link information generating unit 3503 sets counter N 
to "0," then increments the value of counter M every time 
the value of counter N is incremented. 

In the above-described process, pairs of image 3701 and 
link information 3702, image 3801 and link information 
3802, and image 3901 and link information 3902 are gen- 
erated. 

Suppose channel 12, among a plurality of broadcasting 
channels received by display unit 154, is assigned to an 
Internet broadcasting, and that the button "12" on the remote 
controller specifies channel 12. When signal receiving unit 
156 receives the signal of button "12" from the remote 
controller during a reproduction of a general TV broadcast- 
ing channel, image 3701 as shown in FIG. 37 is read from 
temporary information storage unit 2208 and is displayed on 
display unit 154. Here, if button "1" is pressed on the remote 
controller, hot spot 1 OSAKA is selected, and the screen 
displays the image of HTML document "Osaka. html" 2401. 
To return to the general TV broadcasting channel, button CH 
3604, then, one buttons "1" to "11" is pressed. 

Now, the operation unique to the third embodiment is 
described with reference to the flowchart as shown in FIG. 
40. Image generating unit 3502 assigns an image storage 
area and a link information storage area in temporary 
information storage unit 2208 to a display image (S4002). It 
is judged whether temporary document storage unit 2204 



